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Abstract 

The  physical  motivation  and  rigorous  proof  of  convergence  for  a  particular  network  of 
nonlinear  coupled  oscillators  are  reviewed.  Next,  the  network  and  convergence  proof  are  gener¬ 
alized  in  several  ways,  to  make  the  network  more  applicable  to  actual  engineering  problems.  It 
is  argued  that  such  coupled  oscillator  circuits  are  more  natural  to  implement  in  analog  hardware 
than  other  types  of  dynamical  equations  because  the  signal  levels  tend  to  remain  at  sufficiently 
large  values  that  effects  of  offsets  and  mismatch  are  minimized.  Examples  of  how  analog  imple¬ 
mentations  of  these  networks  are  able  to  address  actual  control  problems  are  given.  The  first 
example  shows  how  a  pair  of  coupled  oscillators  can  be  used  to  compensate  for  the  feedback  path 
phase  shift  in  a  complex  LMS  loop,  and  has  potential  application  for  analog  adaptive  antenna 
arrays  or  linear  predictor  circuits.  The  second  example  shows  how  a  single  oscillator  circuit  with 
feedback  could  be  used  for  continuous  wavelet  transform  applications.  Finally,  analog  CMOS 
implementation  of  the  coupled  oscillator  dynamics  is  briefly  discussed. 


This  research  was  supported  in  part  by  the  National  Science  Foundation’s  Engineering  Research 
Centers  Program:  NSFD  CDR  8803012,  and  by  the  AFOSR  University  Research  Initiative 
Program,  under  grant  AFOSR-90-0105  and  AFOSR-F49620-92-J-0500.  Also,  the  authors  ac¬ 
knowledge  the  Office  of  Naval  Research  for  their  support  of  this  work.  Finally,  this  work  was 
partially  supported  by  a  National  Science  Foundation  Graduate  Fellowship. 


1 


1.  Introduction 


Networks  of  coupled  oscillators  have  been  proposed  for  various  applications,  including 
locomotion  (specifically,  central  pattern  generators)  [1],  pattern  recognition  (for  instance,  dis¬ 
tinguishing  between  different  objects  in  view  simultaneously),  and  biological  information  pro¬ 
cessing  (as  a  solution  to  the  dynamic  binding  problem  [2, 3, 4, 5]).  There  is  evidence  that  coupled 
oscillator  networks  play  a  role  in  biological  systems  [6],  but  the  point  of  view  taken  in  this  work 
is  that  the  mathematical  analysis  of  coupled  oscillator  networks  can  also  yield  networks  which 
are  useful  in  their  own  right  for  applications  in  pattern  recognition  and  control.  In  particular, 
coupled  oscillator  networks,  with  their  generally  large  and  predictable  signal  levels,  appear  to 
be  better  suited  to  analog  VLSI  implementation  than  other  dynamical  systems  because  offset 
and  mismatch  problems,  which  lead  to  large  relative  errors  at  small  signal  levels,  are  minimal 
at  large  signal  levels. 

The  basic  network  examined  in  this  paper  is  given  by 

Vj  =  -Vi  +r(P\xj\)-rn 

\Xj\ 

n 

xj  =  ^VkWjk,  i  =  l,...,n  (1) 

k= 1 

where  Xj  and  yj  are  complex  numbers  Vj,  Wjk  are  fixed  complex  interconnecting  weights  with 
wjj  =  0  Vj  and  Wj =  w*k-  (i.e.,  the  weight  matrix  is  Hermitian),  (3  is  a  scalar  parameter,  and 
r(-)  :  [0,oo)  — >  3?  is  a  memoryless  strictly  monotone  increasing  nonlinearity  with  r(0)  =  0  and 
limTO_).00  r(m)  =  1  (later  to  be  specified  precisely)  [8].  r(-)  is  also  assumed  to  be  analytic,  and 
the  function  r(/3|2:|)pi  :  C  — >  C  is  a  well-defined  function  which  compresses  the  magnitude 
of  its  complex  argument  while  retaining  its  angle. 

For  the  jth  unit  (or  oscillator),  yj  may  be  thought  of  as  its  state,  and  xj  represents  its 
input  from  the  rest  of  the  network.  Because  the  states  are  complex,  each  unit  carries  both  phase 
and  amplitude  information,  and  it  is  the  phase  information  which  is  of  primary  interest.  In  the 
coupled  oscillator  context,  the  phases  of  coupled  oscillators  oscillating  at  the  same  frequency  are 
represented. 
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The  reason  for  choosing  these  dynamical  equations  is  that  they  represent  a  very  simple 
method  of  defining  a  coupled-oscillator  network.  The  input  to  each  unit  is  the  weighted  sum 
of  the  states  of  the  other  units,  where  the  weights  themselves  are  complex  (and  thus  may  alter 
the  phase  as  well  as  the  amplitude  of  the  signals  they  weight).  The  input  to  each  unit  is  then 
passed  through  a  memoryless  saturating  nonlinearity  whose  gain  is  a  parameter,  and  the  result 
is  then  low-pass-filtered  to  produce  that  unit’s  state. 

It  turns  out  that  the  oscillator  network  described  by  (1)  can  be  derived  from  a  mean- field 
analysis  of  a  stochastic  physical  oscillator  problem,  as  discussed  by  Zemel,  et.  al.  [8].  Fur¬ 
thermore,  the  physical  motivation  leads  to  a  Lyapunov  function  which  can  be  used  to  rigorously 
prove  stability  of  the  network,  in  the  sense  that  every  trajectory  must  converge  to  an  equilibrium 
point  in  the  ambient  space  !R2"  in  which  the  complex  Xj,  j  =  1,  ...,n,  evolve  [9,10]. 

However,  to  proceed  further,  careful  examination  of  the  form  of  the  Lyapunov  function 
is  required.  The  main  contribution  of  this  work  is  an  explanation  of  three  ways  in  which  the 
dynamical  equations  can  be  modified,  but  for  which  the  Lyapunov  function  can  also  be  modified 
to  retain  the  convergence  property.  With  these  generalizations,  the  coupled  oscillator  network 
is  much  better  suited  to  potential  real-world  applications. 

With  the  convergence  analyses  complete,  the  focus  turns  next  to  simple  examples  illustrat¬ 
ing  how  such  networks  can  be  usefully  applied  to  high-speed  analog  circuit  problems.  The  first 
example  shows  how  a  pair  of  coupled  oscillators  can  be  used  to  compensate  for  the  feedback  path 
phase  shift  in  a  complex  LMS  loop,  and  has  potential  application  for  analog  adaptive  antenna 
arrays  or  linear  predictor  circuits.  The  second  example  shows  how  a  single  oscillator  circuit  with 
feedback  could  be  used  for  continuous  wavelet  transform  applications.  Finally,  analog  CMOS 
implementation  of  the  coupled  oscillator  dynamics  is  briefly  discussed.  Application  of  nonlinear 
coupled  oscillator  theory  to  high-speed  analog  circuits  is  a  recent  development  [11,12], 
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2.  Fixed- Weight  Network  Analysis 
2.1  Introduction 


The  dynamics  given  by  (1)  can  be  rewritten  solely  in  terms  of  the  Xj  variables: 


=  Y,  ilkWjk 


=  J2[~yk  + 


pS) 


Xk 

k  k  1^1 

=  -Xj +  ^r(f3\xk\)^w*k. 


=  Y,y ■  Y,r{  lx>'  '—"'ji- 


(2) 


These  dynamics  were  proposed  and  physically  motivated  by  Zemel,  et.  al.  [8];  however,  their 
proof  of  convergence  was  incomplete.  After  a  review  of  the  physical  motivation,  a  rigorous  proof 
of  convergence,  in  the  sense  that  each  trajectory  asymptotically  converges  to  an  equilibrium  point 
of  the  dynamics,  will  be  presented  (see,  for  earlier  versions,  [9,10]).  Furthermore,  it  is  shown 
that  convergence  of  (2)  implies  convergence  of  (1),  even  if  the  weight  matrix  is  not  invertible. 


2.2  Physical  Motivation 

Zemel,  et.  al.  propose  first  a  stochastic  network  of  directional  units  (complex-valued  ran¬ 
dom  variables  with  magnitude  one  and  angle  representing  directional  information)  intercon¬ 
nected  by  complex  weights  which  are  considered  fixed  [8].  The  directional  units  evolve  accord¬ 
ing  to  probability  distributions  determined  by  the  other  directional  units  and  interconnecting 
weights.  The  stochastic  network  is  then  simplified  using  the  mean-field  approximation  to  give 
a  deterministic  network.  The  purpose  of  examining  the  stochastic  network  is  that  it  provides 
insight  for  the  stability  analysis  of  the  deterministic  network. 


To  begin  the  stochastic  network  analysis,  consider  a  network  of  directional  units,  each 
represented  by  a  random  variable  Zj  taking  values  on  the  unit  circle  in  the  complex  plane. 
The  directional  units  are  interconnected  by  fixed  complex  weights  Wjk  satisfying  Wjj  =  0  and 
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Wkj  =  w*k.  Defining  Xj  =  J2kzkwjk  to  represent  the  interaction  of  unit  j  with  the  rest  of  the 
network,  the  angle  of  Xj  is  related  to  the  mean  value  of  Zj.  and  the  magnitude  of  Xj  is  inversely 
related  to  the  variance  of  Zj  (the  precise  dependence  to  be  determined  below). 


Next,  a  quadratic  form  representing  “energy”  in  terms  of  unit  states  and  interconnecting 
weights  is  defined: 

E(z)  =  -^zTWz*  =  ~\Y!z3zkwiki  z  =  (z1,...,zn)T.  (3) 

j,k 

Because  W  is  hermitian  ( i.e. ,  w^j  =  Wjk),  E{ z)  is  real-valued.  (This  definition  of  energy 
generalizes  the  Hopfield  energy  function  for  binary  units  [8].)  Using  Xj  =  zkw*jk  and  changing 
to  polar  coordinates:  Xj  =  « j<  and  Zj  =  e'^1  (recall  that  \zj\  is  constrained  to  equal  1),  we 
define 

Ej(  z)  =  ~\[zjX*  +  (zjX*)*] 

=  —  cij  cos(cf)j  —  otj)  (4) 

as  unit  jfS  contribution  to  the  total  energy.  Then  E( z)  =  ^J2jEjiz)-  (Observe  that  when 
the  angle  of  Xj  is  aligned  with  the  angle  of  Zj,  unit  j  is  in  a  low-energy  state.)  Introducing  a 
“Boltzmann  factor”  j3  (interpreted  as  the  reciprocal  of  temperature),  and  taking  the  probability 
density  that  the  jtli  unit  is  in  a  state  Zj  =  to  be  proportional  to  e~^E^z\  we  obtain: 

fZj  ( : ; )  x  r  “U.  (5) 


where  Zj,  the  state  of  unit  j,  is  a  random  variable  taking  values  on  the  unit  circle  in  the  complex 
plane  and  fz3  ( • )  is  a  probability  density  function.  Appropriate  normalization  gives 


_ z _ e"ij  cos(  A  -  A )  ^ 

27r/o(raj) 


hi  j  —  (3a  j,  (j)  j  — 


(6) 


where  lo(-)  is  the  modified  Bessel  function  of  the  first  kind  and  order  zero.  This  is  known  as  the 
Von  Mises,  or  circular  normal,  distribution,  and  it  is  a  distribution  for  circular  random  variables 
having  some  characteristics  similar  to  the  usual  normal  distribution  for  linear  random  variables 
[13].  A  circular  normal  distribution  is  completely  characterized  by  two  parameters:  a  mean 
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direction  <f>  E  [0,  2ir)  and  a  concentration  parameter  m  >  0  which  corresponds  to  the  reciprocal 
of  the  variance  of  a  linear  normal  random  variable. 

Next,  Zemel,  et.  al.  apply  a  mean-field  approximation  to  come  up  with  a  deterministic 
network  model.  In  the  mean-field  approximation,  the  random  variables  Z:i  are  replaced  by  their 
means  yj  =<Zj>  and  are  treated  as  independent  (even  though  they  are,  in  fact,  highly  coupled). 
The  mean  <Zj>  of  a  Von  Mises  random  variable  is  a  complex  number  y.j  =  r;  e'7j  with  7 j  =  cf>j 
and  Tj  =  Figure  2.1  shows  r?  as  a  function  of  my  it  is  strictly  monotone  increasing, 

passes  through  the  origin,  and  satisfies  limTOj._),00  rj(rrij)  =  1. 


Figure  2.1:  Plot  of  Tj  =  j  (from  [5]). 


The  dynamics  for  the  deterministic  network  are  chosen  to  be 

^  =  ~xj  +  J2vkw*jk  (7) 

tu  k 

so  that  at  equilibrium,  xj  =  Ylkykwjk^  in  analogy  with  the  expression  Xj  =  Ylk2^’^  l°r  the 
stochastic  network.  Furthermore,  yj  =  r(/3\xj\)j^j,  so  that  if  xj  is  viewed  as  determining  the 
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mean  and  concentration  parameter  of  a  Von  Mises  distribution  according  to  (6),  yj  will  be  the 
mean  value  of  the  distribution.  The  deterministic  dynamics  can  be  expressed  in  terms  of  the  Xj 
alone  as: 

^  =  ~x> +  ^rWM)Pt\w‘ik'  (8) 

The  total  energy  for  the  deterministic  network  is  found  by  taking  the  mean  of  the  total 
energy  expression  for  the  stochastic  network  (and  assuming  the  units  are  independent): 

<E>=  _lj2yjy*kwjk.  (9) 

j,k 

Furthermore,  the  “entropy”  for  the  deterministic  network  is  found  by  summing  the  entropies  of 
the  individual  units  of  the  stochastic  network  (again  using  the  independence  assumption): 

H  =  J2  +log(27T IoiPaj))  .  (10) 

j  l  1o{paj) 

With  these  definitions  of  <E>  and  H ,  a  Lyapunov  function  corresponding  to  what  Zemel 
et.  al.  call  “free  energy,”  F  =<E>—TH,  T  =  -4,  can  be  computed,  and  this  Lyapunov  func¬ 
tion  can  be  used  to  prove  convergence  of  the  deterministic  network  using  LaSalle’s  invariance 
principle. 

2.3  Proof  of  Convergence 


As  will  now  be  shown,  the  deterministic  dynamics  (2)  are  convergent:  every  trajectory 
converges  to  an  equilibrium  point.  LaSalle’s  invariance  principle  is  invoked  to  prove  this,  and  a 
Lyapunov  function  based  on  the  physically  motivated  “free  energy”  is  used. 
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which  gives  a  well-defined  vector  field  on  8?2n,  the  state  space  for  purposes  of  the  proof  of 


con- 


x?"w^i-\-x  !w! 


X,  w.,  —x,w 


vergence.  (If  x k  =  0,  we  take  r(/3\xk\)  k  }\xk\k  }k  =  r(P\xk\)' k  lk  =  0-)  The  equilibrium 

points  of  the  dynamics  are  points  where  xf  =  x[  =  ...  =  =  xTn  =  0. 


At  any  point  in  the  state  space  5R2n,  except  where  x ^  and  Xj  are  both  zero  for  some  j,  we 
can  define  a  valid  (nonsingular)  change  of  coordinates  by  xj  +ixj  =  o.jeIOti .  j  =  1,  ...,n.  In  the 
new  coordinates,  the  dynamics  become: 


aj  =  -aj  +  J2r((3ak)bjkcos{ak  -  atj  -  9jk) 

k 

aj  =  r(Pak)bjk  sin (ak  -  aj  -  6jk), 

ai  k 

where  wfk  +  iwjk  =  bjke l0ik. 


(12) 


At  all  points  in  5ft2"  where  the  change  of  coordinates  is  valid,  we  define  the  Lyapunov 
function  (simply  the  free  energy  <E>—TH,  T  =  -j): 

V  =  -  J2  r(Pai)r(Pak)bjk  cos (ak  -  aj  -  6jk) 

j<k 

-T  J2  [  ■iajr(.-iaj)  +  log  (27r/0(/3ai))]  (13) 

j 

where  log  denotes  the  natural  log.  (Keep  in  mind  that  Wjk  =  w*k-,  Wjj  =  0,  and  f3  =  ^.)  It  turns 
out  that  V  can  be  continuously  defined  even  where  the  change  of  coordinates  is  singular,  because 
if  either  aj  or  ak  is  taken  to  be  zero  in  the  above  formula  for  V,  the  term  r(/3aj  )r(/3ak)bjk  cos  (ak  — 
aj  —  9jk)  will  be  zero  regardless  of  the  value  of  aj  or  ak.  Let  i ^  =  a, .  i  =  1 . 2, ....  n  and 
k'i+n  =  *  =  1,2,  ...,  n. 


Calculating  V{u)  =  we  obtain 


v{”)  =  -E  W 


~ai  +  '22r(Pak)bjkcos(ak  -  aj  -  9jk) 

k 


+ 


r{(3cij 


J2  r(l3ak)bjk  sin(afc  -  n;  -  9jk) 

.  k 


(14) 
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Note  that  r(/3a,j)  >  0  Vaj  >  0  and  iS&hl  >  o  Voj  >  0.  Also,  r'(/3cij)  — »  ^  as  aj  — >  0,  and 
1  ^Qj  — »  fir' (fia j)  as  aj  — >  0. 


Thus,  V’(t')  <0  Vflj  >  0  Vttj,  and  F(z^)  =  0  if  and  only  if 
-aj  +  Y  r(Pak)bjk  cos (ak  -  aj  -  6jk)  =  0 

<  k 

Y  r^ak)bjk  sin (ak  -  aj  -  0jk)  =  0 

L  k 


Vj 


1, ...,  n. 


(15) 


But  this  will  hold  at  a  point  Xj  =  ajel0li  Vj  where  the  change  of  coordinates  is  valid  if  and  only 
if  it  is  an  equilibrium  point  of  the  dynamics. 


We  now  show  that  the  Lyapunov  function  V(u)  has  bounded  sublevel  sets,  because  this 
will  enable  us  to  exhibit  compact  sets  which  are  positively  invariant  under  the  dynamics,  as 
required  to  apply  LaSalle’s  invariance  principle.  Observe  that  the  first  term  of  V, 

-  Y  r(@aj)r(Pak)bjk  cos (ak  -  aj  -  9jk ),  (16) 

j<k 

is  bounded  as  aj  — >  oo  for  any  (or  all)  aj,  A  straightforward  but  lengthy  calculation  shows  that 
Pajr(Paj)  —  log  (2nIo(Paj))  — >  oo  as  aj  — >  oo.  Then  because  Pajr(Paj)  —  log  (2ttIo (Paj))  > 
0  kJaj  >  0,  and  because  the  terms  Pajr(aj)  —  log  (2nIo(Paj))  appear  summed  in  V.  it  follows 
immediately  that  V  is  radially  unbounded  in  the  aj  (where  by  definition  V  :  3ft”  — >  is  radially 
unbounded  in  its  argument  a  E  if  V(a)  — >  oo  as  ||a||  — >  oo  [14]).  Moreover,  since  V  is 
continuous  even  at  points  where  the  change  of  coordinates  is  singular,  we  can  conclude  that  V 
has  bounded  sublevel  sets  when  viewed  as  a  function  of  (xf  ,x[, ...,  x^,  x^). 

So  far  we  have  shown  that  there  is  a  Lyapunov  function  V  continuous  on  all  of  $i2n,  which 
has  bounded  sublevel  sets,  and  which  has  V (u)  <  0  provided  v  is  not  an  equilibrium  point  and 
provided  v  is  not  a  point  where  our  change  of  coordinates  is  singular.  What  we  will  now  show  is 
that  there  is  no  loss  of  generality  in  assuming  that  a  trajectory  will  pass  through  points  where 
the  change  of  coordinates  is  singular  only  at  isolated  points  in  time. 

Specifically,  we  will  show  that  if  a  trajectory  has  x^(t*)  =  Xj(t*)  =0  for  some  j  G  {1, ...,  n} 
and  for  some  t*  then  either  t*  is  an  isolated  point  in  time  for  which  xj  =  x1-  =  0  or  else 
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xf  =  xj  =  0  >  0.  If  xf  =  Xj  =  0  Vf  >  0,  then  simply  eliminate  the  xf  and  Xj  coordinates 

and  consider  the  reduced  system  of  dimension  JR2"-2.  Repeating  this  test  will  reduce  the  system 
to  a  new  system  with  coordinates  {xf ,  x{,  ...,xf,  xf)  with  n  <  n.  The  trajectories  of  the  reduced 
system  will  have  xf{t*)  =  Xj(t*)  =  0  only  at  isolated  time  instants  f*,  and  hence  we  will  have 
V  =  0  only  at  equilibrium  points  and  at  isolated  times  t* .  (It  is  easy  to  verify  that  the  reduced 
system  has  exactly  the  same  form  in  terms  of  dynamics,  equilibria,  and  Lyapunov  function  as 
the  original  system.) 

Analyticity  properties  are  the  key  to  showing  that  the  system  can  be  reduced  so  that 
xf  =  Xj  =  0  for  some  j  only  at  isolated  points  in  time.  That  the  right-hand-side  of  the 
differential  equation  for  {xf  (i),  x[{t), xf{t),  xTn{t)),  equation  (11),  is  analytic  in  the  variables 
xf,x{,...,xf,  xTn  follows  straightforwardly  from  basic  properties  of  analyticity  (using  methods  in, 
e.g.,  [15]).  This  in  turn  implies  that  the  trajectory  {xf{t),x[{t),...,xf{t),x^{t))  is  an  analytic 
function  of  t  (the  necessary  results  on  analyticity  and  differential  equations  can  be  found  in 
[16]).  Therefore,  for  any  j  E  {l,...,n},  {xf,Xj)  will  be  an  analytic  function  of  t.  Hence  if 
xf{t*)  =  Xj{t*)  =0  then  either  t*  is  an  isolated  point  in  time  for  which  xf  =  Xj  =  0  or  else 
xf  =  Xj=0  Vf  >  0. 

We  have  a  well-defined,  C°°  (in  fact,  analytic)  vector  field  (11)  on  JR2"  and  a  Lyapunov 
function  V  which  has  bounded  sublevel  sets.  For  simplicity,  think  of  the  vector  field  abstractly, 
as  given  by  v  =  f{v),  with  Lyapunov  function  V{v).  Also,  V{u)  <  0  along  trajectories. 

Fix  c  >  0  and  let 

Qc  =  {v  G  ^2n\V{v)  <  c}.  (17) 

In  order  to  apply  LaSalle’s  invariance  principle,  the  chief  control  theory  tool  which  applies  to 
this  problem,  we  need  to  show  that  flc  is  a  compact  positively  invariant  set.  We  have  already 
shown  that  the  Lyapunov  function  has  bounded  sublevel  sets,  and  hence  f lc  is  bounded.  In  fact, 
it  can  be  easily  shown  that  is  closed  as  well,  and  hence  is  compact.  Positive  invariance  of 
follows  from  the  fact  that  V{v)  <  0  along  trajectories. 
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Theorem  2.1  (LaSalle’s  invariance  principle):  Let  12  be  a  compact  set  and  suppose  the 
solution  v{t)  starting  in  17  stays  in  17  for  all  t  >  0.  Let  V  :  17  — >  JR  be  a  continuous  function  such 
that  V is  a  monotone  nonincreasing  function  of  t.  Let  E  be  the  set  of  all  points  in  17  where 
V(v)  exists  and  equals  zero.  Let  M  be  the  largest  invariant  set  in  E.  Then  u(t)  approaches  M 
as  t  — >  oo. 

Proof:  (See  [14].) 

Theorem  2.2 :  The  dynamics  (11)  converge  to  an  equilibrium  point. 

Proof:  For  any  initial  condition  tq,  reduce  the  system  if  necessary  so  that  we  may  assume 
that  the  coordinate  transformation  is  only  singular  at  isolated  points  in  time.  Also,  choose  c  >  0 
to  be  greater  than  or  equal  to  V (;z0).  Then  the  set  17  in  Theorem  2.1  is  taken  to  be  17c,  as  defined 
earlier,  which  is  a  well-defined  compact  subset  of  5R2”  when  viewed  in  {xf.  x[, ...,  x^,x^)  coordi¬ 
nates.  Because  the  vector  field  is  well-defined,  the  Lyapunov  function  is  monotone  nonincreasing 
along  trajectories,  and  the  set  S7C  is  compact,  it  follows  that  the  trajectory  u(t)  exists  and  stays 
in  !7C  Vt  >  0.  Thus,  the  hypotheses  of  Theorem  2.1  are  satisfied,  enabling  us  to  conclude  that 
the  trajectory  will  converge  to  the  largest  invariant  subset  of  the  set  of  points  in  17c  such  that 
V(v)  =  0.  But  the  largest  invariant  subset  of  the  set  of  points  with  V{v)  =  0  are  just  the 
equilibrium  points  of  the  system  which  lie  inside  17c. 

LaSalle’s  Principle  thus  enables  us  to  conclude  convergence  of  any  trajectory  to  the  set  of 
equilibrium  points  of  the  dynamics,  but  not  to  a  specific  equilibrium  point.  We  will  now  show, 
by  appropriate  choice  of  inner  product,  that  the  system  follows  gradient  dynamics  except  at 
isolated  points  in  time.  At  points  v  =  (oq, ...,  an ,  aq, ...,  an),  define  the  inner  product: 

=  vlTdia.g{(3r'{(3ai), ..., (3r'{(3an),  oqr(/?ai), ...,  a„r(/3a„))u2,  (18) 

where  vl  and  w2  are  two  tangent  vectors  at  the  point  v.  Then  (v,vv)  =  —duV  ■  v v  =  (-VF,wv) 
so  that  v  =  —  VF;  i.e. ,  the  system  satisfies  gradient  dynamics  (except  at  isolated  time  instants). 
Thus,  we  may  conclude  that  in  fact  the  dynamics  (11)  converge  to  an  equilibium  point.  Q.E.D. 
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2.3  Application  of  Convergence  Result 


The  convergence  result  just  proved  implies  the  convergence  of  the  complex  dynamics  (2). 
An  additional  argument  is  required  to  conclude  that  the  dynamics  of  equation  (1)  converge. 
Because  the  xj  converge  to  constant  values,  the  terms 

Uj  =r(P\xj\)^L,  (19) 
\xj\ 

also  converge  to  constant  values  (by  continuity).  Now  consider  the  system 

!Jj  Uj  '  ".a  (20) 

which  is  clearly  globally  asymptotically  stable  if  the  Uj  are  constant.  Because  the  xj  trajectories 
remain  bounded,  so  do  the  Uj ,  and  it  is  not  hard  to  see  that  the  Uj  remaining  bounded  implies 
that  the  yj  trajectories  also  remain  bounded.  Therefore,  the  yj  asymptotically  converge  to  an 
equilibrium  point  [17]. 

2.4  Generalization  to  a  Class  of  Networks 

Although  the  choice  of  r(-)  as  the  ratio  of  bessel  functions  enabled  a  physical  motivation 
to  be  given  for  the  dynamics,  careful  examination  of  the  proof  of  convergence  reveals  that  as 
long  as  r(-)  satisfies  certain  properties,  the  convergence  result  will  still  hold.  First,  the  function 
r(-)  must  be  strictly  monotone  increasing  with  r(0)  =  0.  Second,  r(-)  must  be  analytic.  Third, 
we  need  to  ensure  that  a  suitable  radially  unbounded  Lyapunov  function  exists: 

V  =  -  r(ai)r(ak)bjk  cos (ak  -  oij  -  6jk)  +  ^  h(a,j)  (21) 

j<k  j 

where  lim^oo  =  oo,  =  ar'(a),  and  h( 0)  =  constant. 

The  ability  to  generalize  the  convergence  proof  to  a  class  of  networks  in  this  manner  is 
important  when  analog  implementations  of  these  networks  are  considered.  Although  saturating 
nonlinearities  can  be  achieved  in  analog  hardware,  a  saturating  nonlinearity  for  the  magnitude 
of  a  complex  number  which  leaves  the  phase  unaltered  is  more  complicated  [9]. 


12 


3.  Adaptive  Control  Law  for  a  Variable- Weight  Network 


3.1  Motivation  for  the  Adaptive  Control  Law 

The  usefulness  of  the  network  presented  in  the  last  section  would  be  greatly  enhanced  if 
the  weights  were  not  constrained  to  be  constant.  An  adaptive  control  law  for  variable  weights 
is  now  described  which  retains  the  convergence  properties  of  the  fixed-weight  network  -  namely, 
the  variable  weight  network  with  adaptively  controlled  weights  is  shown  to  converge  to  an 
equilibrium  point.  The  utility  of  the  rigorous  proof  of  convergence  for  the  fixed- weight  network 
is  that  it  can  be  extended  to  more  general  and  useful  networks,  of  which  the  adaptive  control 
law  described  here  is  an  example. 

The  mathematical  motivation  for  the  adaptive  control  law  comes  from  viewing  the  dy¬ 
namics  and  Lyapunov  function  abstractly  and  performing  some  calculations.  Abstractly,  for  the 
fixed-weight  case  we  have 


v 

V  {v,  w ) 
V (v,  w) 


f(v,w)  (dynamics) 
(Lyapunov  function) 


dV_ 

dv 


/(^ 


-  <  >  . 


Now  letting  some  of  the  weights  be  feedback  functions,  we  have 


provided 


v 

V(v,w(v)) 
V  (v,w(v)) 


f  (v,w(v))  +  g(v)  (dynamics) 

(Lyapunov  function) 

( dV  dVdw\ 

(a7  +  (/(‘'.'"Ml  +  sM) 

-  <  f{v,w{v))  +  g{v),f{v,w{v))  +g{y)  > 


f  dV  dw  \ 
V  dw  dv  ) 


V  =  -  <  g{v),r)  >  ■ 


(22) 


(23) 


(24) 
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In  the  transformed  coordinates,  this  condition  becomes 

=  ~[Pr'{f3a1)g1{u)  ■  ■  ■  f3r'{f3an)gn{u) 

air{(3ai)gn-fi(v)  ■  ■  ■  anr{(3an)g2n{v)]- 


Suppose  unit  j  interconnects  units  1 \  and  1% ,  and  all  other  weights  are  constants.  Fur¬ 
thermore,  suppose  bi1%i2  depends  only  on  a.j  and  6iui2  depends  only  on  .  Then  for  V  as  in 

(13), 


=  [°'"°  ~  riPah  )r(Pai2 )  °°^h  cos  {ah  -  ah  -  dhj2 )  0  •  •  •  0 

0  •  •  •  0  -  r((3ah)r{(3ai2)bhj2  sin(ori2  -  ah  -  °-"0] 


dbluh 


where  the  first  nonzero  term  is  in  position  j  of  the  row  vector,  and  the  second  nonzero  term  is 
in  position  j  +  n. 

If  we  choose  bhj2(aj)  =  diui2r((3cij )  and  diui2{aj )  =  ocj ,  then  =  diui2j3r'{j3aj)  and 

=  i  go 

—  —  =  -[o---0  f3r'{f3aj){diuhr{f3ah)r{f3ai2)cos(ai2  -  ah  -a,))  0---0 

0  •  •  •  0  cijr((3aj)  (j^dh ,i2r{f3cth  )r(f3ah)  sm{oq2  -  ah  -  aj)  j  0  •  •  •  o] 


where  again  the  nonzero  terms  are  in  positions  j  and  j  +  n  of  the  row  vector. 


Thus,  letting 


iW)  =  di^i2r{f3ah)r{f3ai2)cos(ai2  -  ah  -  aj) 

=  —  dhj2r{f3ah)r(f3ai2)sin{oih  -  ah  -  aj) 

aj 

=  0,  k^j,j  +  n 


we  then  have 


dVdw 
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To  prove  convergence  of  the  adaptive  control  law,  we  start  with  the  dynamical  equations 
just  given,  (30)- (31) ,  along  with  the  Lyapunov  function 

V  =  -  r(Paj)r(Pak)bjk  cos {ak  -  aj  -  0jk) 

j<k 

-T  [-PcijriPcij)  +  log  (2tt I0(/3aj))] ,  (32) 

j 

where  now  we  may  have  bjk  =  djkr(f3ai)  and  6jk  =  for  various  j,  k,  l. 

The  new  calculation  of  V  gives: 

V(v)  =  “5 2\Pr'(Paj )  ~  aj +  ^2r{f3ak)bjkcos{ak  -  aj  -  djk) 
j  *■  L  k 
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+  ^2  Ii1,i2diukr(Pah)r(Pah)  cos  ( ai  2  —  a ^  —  Q!j) 

h  ,h 

+  r{fchl  Y,r{(3ak)bjksm{ak-aj-6jk) 
ai  L  k 

+  J2ILl2dh,k'r(Pah)r(Pah)sMai2-ah-aj)  L  (33) 

h,h  J  J 

From  this  point  on,  the  proof  of  convergence  is  basically  the  same  as  the  convergence  proof  for 
the  fixed-weight  case.  The  reason  for  labeling  the  feedback  law  an  adaptive  control  law  is  that 
the  original  dynamics  were  linear  in  certain  parameters  (the  weights),  which  are  now  adapted 
according  to  a  feedback  law  which  guarantees  convergence.  In  this  way,  coupled  oscillator 
networks  can  be  designed  to  adapt  in  the  presence  of,  for  example,  fixed  but  (a  priori)  unknown 
weight  values. 

3.3  Application  of  the  Adaptive  Control  Law  Convergence  Result 


The  adaptive  control  law  just  derived  is  in  the  form  corresponding  to  equation  (2)  rather 
than  equation  (1)  for  the  fixed- weight  case.  Therefore,  we  need  to  determine  how  equation 
(1)  should  be  modified  to  correspond  to  equation  (31).  A  calculation  (shown  in  [9])  gives  the 
required  modification  to  (1): 


There  is  an  interesting  implication  of  the  adaptively  controlled  network  convergence  result 
in  terms  of  hierarchical  control  of  coupled  oscillator  networks.  If  two  or  more  networks  are 
arranged  in  a  hierarchical  fashion,  with  the  units  of  one  network  serving  as  the  weights  for  the 
next  network  in  the  hierarchy,  the  convergence  result  implies  that  feedback  can  be  applied  from 
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lower  levels  to  higher  levels  and  stability  will  be  maintained,  as  long  as  the  adaptive  control  law 
is  obeyed.  Consideration  of  these  networks  of  coupled  oscillators  for  hierarchical  control  systems 
with  local  and  global  feedback  might  therefore  be  worthwhile. 

4.  Network  with  Auxiliary  Control  Inputs 

4.1  Convergence  Result 


Besides  adaptively  controlling  the  weights,  another  way  in  which  it  would  be  useful  to 
extend  the  basic  coupled-oscillator  network  would  be  to  add  auxiliary  inputs  and  determine 
under  what  circumstances  the  network  is  still  guaranteed  to  converge.  So  consider  adding  a 
control  input  term  to  equation  (1): 


Vi  =  -Vj  +  r(P\xi\)-£r\ 

\Xj\ 

n 

Xj  =  J2ykWjk  +  Uj,  j  =  l,...,n.  (35) 

k= 1 


Computing  the  dynamics  for  the  Xj  alone,  in  the  manner  of  equation  (2),  we  find 


=  ~xi  +  Y  r(P\xk\)j^wjk  +  VH 


k= 1 


(36) 


where  Vj  =  Uj  +  uj.  Our  ambient  space,  the  space  in  which  the  trajectories  are  considered  to 
lie,  is  still  5R2n .  Next,  we  change  to  polar  coordinates  using 


Xj 

=  (1  jt ‘ 

'dkjk 

=  bjke iejk 

Vi 

=  djei^j , 

(37) 

so  that  the  dynamics  become 


=  -aj  +  Y  r(Pak)bjk  cos (ak  -  -  Ojk)  +  dj  cos {ipj  -  aj) 


a:  =  — 


L  k 


Y  ''(■')<,k  )l>.ji.  sin (ak  -  aj  -  0jk)  +  dj  sin (ipj  -  u  , 


(38) 
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For  now,  assume  that  the  vj  are  constants  instead  of  functions  of  time,  and  at  all  points 
in  $i2n  where  the  change  of  coordinates  is  valid,  consider  the  new  Lyapunov  function 

V  =  -  Y  r(Paj)r(Pak)bjk  cos (ak  -  aj  -  6jk)  -  Y  r((3a,j)dj  cos(pj  -  aj) 
i<k  j 

-T  Y  [-(3a,jr{(3aj)  +  log  (27r/0(/3ai))] .  (39) 

3 

Calculating  V (v)  =  (under  the  assumption  that  the  Vj  are  constant)  gives 

(  r  1 2 


VH  =  fir' {(3a, 


+ 


j 

r(P°j) 


~  aJ  +  rlyPak)bjk  cos (ak  -  aj  -  6jk)  +  dj  cos (ipj  -  aj) 


r{(3cik)bjk  sin(afc  -  aj  -  0jk)  +  dj  sin  (ipj  -  cij ) 

.  k 


(40) 


Again,  from  this  point  on,  the  proof  of  convergence  with  the  Vj  constant  is  essentially  the  same 
as  in  the  fixed-weight  case. 


The  convergence  result  can  be  extended  to  the  case  where  Uj  and  Vj  are  nonconstant  in  the 
following  manner.  As  long  as  both  Uj  and  uj  are  bounded,  Vj  =  Uj  +Uj  will  also  be  bounded,  and 
hence  for  any  initial  condition,  the  Xj  trajectories  will  remain  bounded.  Therefore,  as  long  as 
Vj  asymptotically  converges  to  a  constant  value,  the  coupled-oscillator  system  will  asymtotically 
converge  to  an  equilibrium  point  [17]. 

4.2  Example:  Feedback  Loop  Phase  Shift  Compensating  Circuit 
4.2.1  Overview  of  the  feedback  loop  phase  shift  problem 


This  example  illustrates  how  the  theory  of  nonlinear  coupled  oscillators  can  be  applied 
to  a  real-world  analog  circuit  problem:  phase  shift  in  the  feedback  path  of  a  complex  LMS 
loop  configured  as  a  frequency-programmable  bandpass  filter.  In  theory,  an  ideal  frequency- 
programmable  two-pole  linear  bandpass  filter  can  be  implemented  using  a  single  complex  LMS 
loop.  However,  one  critical  nonideality  which  must  be  taken  into  account  at  high  center  frequen¬ 
cies  is  phase  shift  through  the  feedback  path  due  to  propagation  delays  and  finite  component 
bandwidths. 
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Figure  4.1  shows  a  single-complex- learning-element  LMS  adaptive  filter  [18].  The  actual 
circuit  used  is  described  in  [19].  In  the  absence  of  feedback  path  delays  and  other  nonidealities, 
by  applying  a  fixed  reference  frequency  to  the  “oscillator  natural  frequency”  input,  the  circuit 
behaves  as  a  bandpass  filter  from  the  “exogenous  input”  to  “output”  ports.  However,  for  certain 
values  of  gain  and  phase  shift  through  the  feedback  path,  labeled  “//”  in  figure  1,  it  is  well-known 
that  the  LMS  loop  becomes  unstable,  in  the  sense  that  the  feedback  becomes  positive. 


GAIN  +  PHASE  SHIFT 


PHASE  OF 
TOTAL  INPUT 
=X 


STATE 
=  PHASE  OF 
OSCILLATOR 
=Y 


Figure  4.1:  Bandpass  filter  circuit  and  oscillator  representation. 


In  the  upper- left  corner  of  figure  4.1  is  a  sketch  of  how  the  system  can  be  viewed  as  an 
oscillator.  The  oscillator  point  of  view  does  not  distinguish  between  stability  and  instability 
based  on  whether  the  feedback  is  positive  or  negative.  Stability  for  the  LMS  model  corresponds 
to  a  stable  equilibrium  point  at  the  origin  for  the  oscillator  system,  and  instability  for  the  LMS 
model  corresponds  to  a  stable  limit  cycle  solution  for  the  oscillator  system  (the  amplitude  of  the 
oscillations  are  limited  in  practice  by  the  range  of  the  analog  elements  used).  To  further  simplify 
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the  oscillator  model,  only  the  oscillator  amplitude  and  phase  (relative  to  the  unforced  natural 
frequency)  are  retained.  This  information  can  be  compactly  modeled  as  a  time-varying  vector 
in  the  complex  plane,  and  is  what  is  represented  by  the  upward  pointing  arrow  labeled  “state” 
in  figure  4.1.  As  will  be  demonstrated,  the  oscillator  point  of  view  leads  to  a  simple  analysis  of 
how  the  LMS  loop  functions  as  a  bandpass  filter. 

4.2.2  LMS  loop  bandpass  filter  mathematical  analysis 

Each  signal  in  the  circuit  is  represented  as  a  complex- valued  function  of  time  with  magni¬ 
tude  corresponding  to  the  amplitude  of  the  signal  and  with  angle  corresponding  to  the  phase  of 
the  signal.  If  the  signal  is  high-frequency,  then  its  phase  is  measured  with  respect  to  the  unforced 
natural  frequency  of  the  oscillator  (in  this  case  the  bandpass  filter  programming  frequency).  The 
goal  is  to  derive  the  transfer  function  from  the  complex  exogenous  input  to  the  state,  which  in 
turn  determines  the  bandpass  filter  characteristic  from  exogenous  input  to  output.  (The  follow¬ 
ing  analysis  is  a  linearized  analysis  about  the  equilibrium  point  at  the  origin  for  the  bandpass 
filter  oscillator,  and  thus  only  applies  when  the  equilibrium  point  at  the  origin  is  stable.) 


Referring  to  figure  4.1,  and  treating  the  integrator  block  as  a  single-pole  low-pass  filter 
with  transfer  function  K/(s  +  u>o),  we  have  the  following  differential  equation  for  the  oscillator 
state  y(t): 

y(t)  =  -w0  y(t)  +  Kx{t ),  (41) 

with  x(t)  is  given  by 

x(t)  =u(t)  -  ny(t),  (42) 


giving 


y(t)  =  -(w0  +  K/j,)y{t)  +  Ku(t). 


Thus,  the  transfer  function  from  input  to  state  is 

y(a)  _  K 

U  (s)  s  +  (wo  +  K/i) 

K 

s  +  (cjq  +  Kbeie)  ’ 


(43) 


(44) 
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where  b  =  |/i|  and  6  =  Z /t . 


From  this  transfer  function,  we  deduce  that  as  the  feedback  path  phase  shift  increases 
toward  instability  for  the  LMS  loop,  the  bandpass  filter  center  frequency  shifts  higher  in  fre¬ 
quency,  and  the  bandwidth  of  the  filter  narrows,  approaching  the  bandwidth  of  the  low-pass 
filters  used  as  the  integrators.  Also,  as  the  feedback  path  phase  shift  increases,  the  filter  gain  at 
the  center  frequency  increases.  Clearly  feedback  path  phase  shift  has  a  profound  effect  on  the 
performance  of  the  complex  LMS  loop  as  a  bandpass  filter. 

4.2.3  Phase  shift  compensation  circuit 

Figure  4.2  shows  a  modification  to  the  circuit  of  figure  4.1  to  allow  an  additional  compen¬ 
sating  phase  shift  to  be  incorporated,  which  could  serve  to  bring  the  overall  loop  phase  shift  to 
zero. 

GAIN  +  PHASE  SHIFT 

EXOGENOUS 
INPUT  - 


Figure  4.2:  Bandpass  filter  circuit  with  compensating  phase  shift. 


21 


Figure  4.3  shows  a  nonlinear  oscillator  diagram  for  the  phase  compensation  circuit.  Oscil¬ 
lators  y  i  and  y 2  are  interconnected  so  that  their  stable  equilibrium  phases  differ  by  the  feedback 
path  phase  shift,  L/i.  The  input  u  to  yi  is  the  bandpass  filter  programming  signal,  which  causes 
the  phase  of  yi  to  allign  with  the  phase  of  the  programming  signal.  Therefore,  the  phase  of  y 2 
converges  to  the  phase  of  the  feedback  path  phase  shift,  Z/t.  The  phase  of  y2  is  in  turn  used  to 
shift  the  phase  of  the  bandpass  filter  feedback  signal  so  correct  for  the  Z/t  phase  shift  through 
the  feedback  path  of  the  bandpass  filter  LMS  loop. 


L 


Figure  4.3:  Coupled  oscillators  for  compensating  bandpass  filter  feedback  phase  shift. 


Figure  4.4  shows  the  general  schematic  for  implementing  the  pair  of  coupled  oscillators 
yi  and  ])•> ■  As  indicated  in  figure  4.4,  complex  conjugation  simply  amounts  to  a  change  in  sign, 
and  hence  with  the  differential  circuits  described  in  [19]  implies  no  additional  circuit  complexity. 
Although  not  shown  explicitly  in  figure  4.4,  it  is  to  be  understood  that  the  upper  row  of  multi¬ 
pliers,  in  particular,  have  a  smoothly  saturating  input  characteristic  with  respect  to  the  input 
signal  from  the  other  oscillator.  Although  all  the  analog  components  have  finite  range,  it  is  the 
saturating  characteristic  of  the  first  multipliers  (in  the  multiply-integrate-multiply  chain)  which 
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are  assumed  to  apply  the  saturating  characteristic  in  the  dynamical  equations  used  to  describe 
the  coupled  oscillator  system. 


OSCILLATOR  NATURAL  FREQUENCY 


Figure  4.4:  Coupled  oscillator  circuit  showing  complex  conjugation. 

The  dynamical  equations  for  the  coupled  oscillators  y\  and  y->  are 

•  i  (  q\  *  i  i  \  vw  t  ^ 

y  1  =  -yi+r(P\y2fi  +ti  I - — — I 

my*  +u\ 

m  =  y>  ■  r(.i  ijw  (45) 

where  coo  is  taken  to  be  1  for  simplicity.  By  the  general  stability  result  of  section  4,  the  oscillator 
network  consisting  of  y\  and  y2  will  converge  to  steady-state  magnitudes  and  phases.  Changing 
to  the  transformed  coordinates,  if  there  is  no  stable  equilibrium  point  with  aj  =  0  for  any  j. 
then  we  can  conclude  that  the  stable  steady-state  phases  of  y\  and  y2  will  be  included  in  the  set 

r((3ak)bjk  sin (ak  -  aj  -  6jk)  +  <l:j  sin (ipj  -  n;)  =  0,  (46) 

k 

which  in  this  case  reduces  to 

r(/3cii)bsm(a2  —  a\  —  8)  +  dsm(ip  —  a\)  =  0 
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r(/?<22)6sin(oq  —  «2  +  0) 


0 


(47) 


where  /t  =  bel°  and  u  =  deiV .  The  desired  equilibrium  solution  is  the  one  for  which  y\  is  alligned 
with  u  and  the  phase  difference  between  y\  and  y->  corresponds  to  the  feedback  path  phase  shift 
of  /i: 


oq 

«2 


(  'P 

y  ip  +  0 


(48) 


The  desired  equilibrium  solution  is  indeed  an  equilibrium  solution,  but  there  are  other 
equilibrium  solutions  as  well.  Futhermore,  we  must  carefully  rule  out  the  possibility  of  a  stable 
equilibrium  point  with  a\  =  0  or  <22  =  0.  For  this  simple  two-oscillator  network,  if  the  steady- 
state  value  of  u  is  nonzero,  then  no  equilibrium  point  has  a\  =  0  or  <22  =  0.  (If  the  steady 
state  value  of  u  is  zero,  the  equilibrium  point  at  the  origin  can  be  destabilized  by  choosing  the 
gain  [3b  sufficiently  large  [9].)  The  technique  for  showing  that  the  desired  equilibrium  point  is 
the  unique  stable  equilibrium  point  uses  the  Lyapunov  function,  which  for  the  two-oscillator 
network  becomes 


V  =  —  r(/3<2i)r(/3<22)&cos(o!2  —  oq  —  0)  —  r  ([3  a\)d  cos  (ip  —  aq) 

-T[-[3air{[3ai)  +  log(27r/0(/3ai))  -  /3a2r(/3a2)  +  log(27r/o(/0a2))]-  (49) 


The  equilibrium  phases  are 


Oi\ 

01 2 

oq 

«2 

Qq 

«2 

Oq 

«2 


ip  +  6 

'Ip  +  TT 

‘Ip  +  7T  +  0 
‘Ip  +  -K  \ 

'lp  +  6  J 

Ip 

Ip  +  7T  +  0 


(the  desired  equilibrium) 


(50) 


However,  for  all  but  the  desired  equilibrium  point,  perturbing  the  equilibrium  angles  in  the 
expression  for  V  is  seen  to  reduce  V.  On  the  other  hand,  for  the  desired  equilibrium  point, 


perturbing  the  equilibrium  angles  in  the  expression  for  V  increases  V.  Hence,  the  desired 
equilibrium  point  is  indeed  the  unique  stable  equilibrium  point. 
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Now  that  we  have  shown  that  yi  and  y 2  converge  appropriately  in  figure  4.4,  with  the 
steady-state  phase  of  2/2  corresponding  to  the  feedback  path  phase  shift  of  y,  it  is  clear  that 
applying  ?y5  directly  to  the  “compensating  phase  shift”  input  to  the  bandpass  filter  in  figure  4.2 
will  bring  the  total  loop  phase  shift  to  zero.  The  complex  conjugation  of  2/2  again  involves  no 
additional  circuit  complexity,  as  it  simply  amounts  to  a  sign  change. 

The  practical  importance  of  the  coupled-oscillator  approach  to  correcting  for  the  feedback 
path  phase  shift  in  the  LMS-loop  frequency-programmable  bandpass  filter  is  that  it  addresses  one 
of  the  major  limitations  of  a  widely  used  and  important  high-speed  analog  feedback  circuit  con¬ 
figuration.  The  frequency-programmable  single-complex-LMS-loop  bandpass  filter  is  a  special 
case  of  a  more  general  network  architecture,  the  least-mean-square-error  adaptive  filter  circuit 
used  in  adaptive  antenna  arrays,  co-site  interference  rejection  circuits,  and  linear-predictor  cir¬ 
cuits  for  separating  coherent  from  noncoherent  signals.  Each  of  these  circuits  requires  feedback, 
and  feedback  path  phase  shift  is  a  major  limitation  at  high  frequencies  of  operation. 

One  aspect  of  the  feedback  path  phase  shift  correction  circuit  worth  emphasizing  is  that 
the  correct  compensating  phase  is  determined  regardless  of  the  feedback  path  phase  shift  over 
the  full  range  from  zero  to  27T.  This  property  indicates  that  coupled  oscillator  circuits  may  prove 
quite  useful  for  high-speed  analog  feedback  circuit  design  problems,  where  signal  phase  shifts 
are  large  and  difficult  to  estimate. 

5.  Single  Feedback  Oscillator  for  Frequency  Translation 
5.1  Convergence  Result 

So  far,  we  have  generalized  the  basic  fixed-weight  network  by  allowing  for  an  adaptive 
control  law  to  update  some  of  the  complex  weights  and  by  allowing  for  auxiliary  inputs.  However, 
in  order  to  guarantee  convergence,  a  key  assumption  was  the  Hermitian  symmetry  of  the  weight 
matrix.  It  turns  out  that  a  simplified  version  of  the  same  basic  technique  for  proving  convergence 
can  also  be  used  for  a  single  oscillator  feeding  back  to  itself  with  an  arbitrary  weight.  In  fact, 
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this  is  precisely  the  situtation  in  the  complex  LMS  loop  with  feedback  path  phase  shift:  the 
complex  LMS  loop  with  a  saturating  characteristic  in  the  high-speed  feedback  path  acts  as  an 
oscillator  with  the  feedback  weight  determined  by  the  feedback  path  phase  shift.  When  used  to 
implement  the  LMS  algorithm,  the  complex  feedback  weight  must  stabilize  the  equilibrium  at 
the  origin,  or  the  circuit  is  considered  “unstable.”  However,  with  a  feedback  path  weight  value 
which  destabilizes  the  origin,  the  circuit  is  stable  in  the  sense  of  converging  to  a  stable  limit 
cycle,  and  this  behavior  can  be  employed  to  translate  the  natural  frequency  of  the  complex  LMS 
loop  viewed  as  an  oscillator  to  a  different  output  frequency  determined  by  the  complex  weight 
in  the  feedback  path.  One  use  envisioned  for  such  a  circuit  is  as  a  reference-frequency  generator 
for  a  continuous  wavelet  transform  (CWT)  circuit. 

Figure  5.1  identifies  the  signals  relevant  to  the  oscillator  analysis:  y  is  a  complex  number 
representing  the  (low-frequency  component  of  the)  input  to  the  low-pass  filter,  x  is  a  complex 
number  representing  the  low-pass  filter  output,  and  c  is  the  complex  input  signal  (supplied  as 
voltages  corresponding  to  its  real  and  imaginary  parts)  providing  phase  shift  in  the  feedback 
path.  (The  x  and  y  signals  are  interchanged  with  respect  to  the  previous  example  to  simplify  the 
algebra.)  The  signal  y  is  passed  through  the  lowpass  filter  with  corner  frequency  lo o  to  produce 
x,  so  one  equation  for  the  circuit  is 

1  ,  . 

— x  =  —x  +  y.  (51) 

coo 

The  high-frequency  positive  feedback  with  sigmoidal  nonlinearity  acts  to  amplify  the  complex 
signal  cx,  and  saturate  its  magnitude  without  altering  its  phase.  This  leads  to  the  second 
equation  for  the  circuit, 

CT 

y  =  ry(\cx\)—  (52) 

\cx\ 

where  /3  is  a  real  constant  and  z  ^  r  y(\z\)-^  \s  a,  comp  lex- valued  function  which  compresses  the 
magnitude  of  its  complex  argument  while  leaving  its  phase  unaltered.  The  small-signal  gain  of 
the  saturation  function  is  parameterized  by  (3.  Combining  these  two  equations  gives 

—x  =  -x  +  ry{\cx\)-^—.  (53) 
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I  IN  (Fr)  Q  IN  (Fr) 


Figure  5.1:  Circuit  for  single  feedback  oscillator  convergence  analysis. 


The  next  step  is  to  change  to  polar  coordinates.  Letting 


3 

'<>■5 

<3 

II 

(54) 

•^5 

^3 

II 

(55) 

we  can  rewrite  the  dynamics  as 

— a  =  —  a  +  rg(da)  cos  9 

UJ0 

(56) 

— «  =  -rn(da)  sin0. 
loq  a 

(57) 

Now,  we  need  to  make  some  assumptions  on  the  sigmoidal  function  rp(-) 

.  First,  assume 

that  the  parameter  / 3  simply  multiplies  the  argument  of  rp(-),  i.e. , 

rp(a)  =  r(/3a)  Va,/?G5R,  a,/3>  0. 

(58) 

Second,  r(-)  must  be  strictly  monotone  increasing  with  r(0)  =  0.  Third,  we  will  assume  for 
convenience  that  r(-)  E  C°°.  Finally,  we  require,  as  in  section  2.4,  that  a  function  h(-)  exist 
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satisfying 


oo, 

ar'(a),  and 

constant.  (59) 

These  assumptions  on  rp{-),  which  are  not  overly  restrictive,  are  required  for  the  following 
convergence  analysis,  which  is  used  to  conclude  that  the  magnitude  a  of  a;  converges  to  an 
equilibrium  value  regardless  of  initial  conditions. 


h(a) 
lmi  -T— 

a—>oo  rz[a) 

dh 

da 

h(  0) 


To  prove  convergence  of  the  oscillator  output  amplitude,  define  the  Lyapunov  function 


V(a) 


— -r(/3da)2  cos  6  +  h(/3da). 


(60) 


We  first  observe  that  our  assumptions  on  r(-)  imply  that  V  is  radially  unbounded  in  its  argument 
a  (recall  that  V(a)  is  radially  unbounded  in  its  argument  a  if  V(a)  — >  oo  as  a  — >  oo).  Next, 
calculating  V(a)  =  ^d,  we  obtain 


— —  =  —f3dr' (/3da)r(/3da)  cos  6  +  (3— 
da  da 

=  —/3dr' (/3da)[— a  +  r(/3da)  cos  6] 

dV 

V(a)  =  —a 
da 

=  —  /3dr' (/3da)[— a  +  r(/3da)  cos  8]2. 


(61) 


(62) 


The  assumptions  on  r(-)  are  sufficient  to  conclude  that  V(a)  <  0  Va,  and  V(a)  =0  if  and  only 
if 


—  a  +  r(/3da)  cos  6  =  0, 


(63) 


which  holds  at  a  point  x  =  ae^a  if  and  only  if  it  is  an  equilibrium  point  of  the  dynamics.  (The 
singularity  in  the  polar  change  of  coordinates  poses  no  problem  because  it  is  easy  to  see  that 
the  origin  is  an  equilibrium  point.  For  the  circuit  to  work  as  an  oscillator,  we  will  want  the 
equilibrium  point  at  the  origin  to  be  unstable.)  Combining  the  radial  unboundedness  of  V(a), 
the  fact  that  V {a)  <0  and  V(a)  =  0  only  at  equilibrium  points,  and  the  observation  that  in  fact 
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the  dynamics  for  a  actually  follow  the  negative  gradient  of  V(a),  we  can  conclude  by  the  same 
arguments  as  in  the  previous  convergence  analyses  that  a  converges  to  an  equilibrium  value. 

5.2  Example:  Continuous  Wavelet  Transform  Circuit 

5.2.1  Overview  of  the  Continuous  Wavelet  Transform  Application 

The  continuous  wavelet  transform  (CWT)  is  currently  seen  as  a  potential  alternative  to 
digital  signal  wavelet  processing  in  certain  application  areas  in  which  the  digital  approach  is 
too  slow  for  real-time  processing.  Passive  monitoring  of  the  electromagnetic  environment,  radar 
systems,  communications,  and  data  compression  are  examples  of  potential  application  areas  for 
the  continuous  wavelet  transform. 

An  analog  (e.g.  microelectronic)  CWT  approach  is  based  on  the  idea  that  the  CWT  can 
be  realized  using  a  bank  of  bandpass  filters.  Furthermore,  because  resolution  in  the  time  domain 
as  well  as  in  the  frequency  domain  is  intrinsically  important  for  the  CWT,  the  bandpass  filters 
can  be  second-order,  the  lowest  order  possible  for  a  bandpass  filter. 

Within  a  CWT  system,  there  are  two  uses  envisioned  for  microelectronic  oscillator  circuits. 
First,  bandpass  detectors  implemented  in  the  form  of  synchronous  receivers  require  reference  fre¬ 
quencies  to  be  available  to  mix  with  the  receiver  input  signal.  As  a  reference  frequency  generator, 
the  feedback  oscillator  circuit  would  be  operating  in  its  steady-state  mode  of  operation. 

The  second  CWT  use  for  the  microelectronic  oscillator  circuit  would  be  to  generate  an 
approximation  to  the  wavelet  corresponding  to  the  bandpass  filter  impulse  response  functions. 
The  impulse  response  of  a  second-order  bandpass  filter  is  a  burst  at  the  center  frequency  of  the 
filter  with  an  exponentially  decaying  envelope  whose  time  constant  is  related  to  the  bandpass 
filter  bandwidth.  The  transient  response  of  the  single  feedback  oscillator  circuit  is  a  burst  at 
a  frequency  determined  by  design  and  with  an  exponentially  growing  envelope.  Therefore,  the 
bandpass  filter  with  the  same  center  frequency  and  bandwidth  corresponding  to  the  exponential 
time  constant  of  the  envelope  serves  as  a  matched  filter  for  the  signal  generated  by  the  oscillator 
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circuit. 


5.2.2  Design  Equations  for  Steady-State  Operation 

Figure  5.2  shows  the  single  feedback  oscillator  circuit  acting  as  a  quadrature  reference 
frequency  generator  for  a  CWT  system.  The  sigmoidal  transfer  characteristic  is  simply  the 
input  saturating  characteristic  of  the  multiplier  which  multiplies  the  feedback  signal  by  the 
high-frequency  reference  input,  and  hence  is  not  a  distinct  component.  Furthermore,  the  low- 
pass  filter  is  just  a  capacitor  placed  across  the  differential  multiplier  outputs,  and  the  summers 
are  simply  nodes  where  currents  combine.  Therefore,  the  oscillator  circuit  really  only  consists 
of  10  multipliers,  and  it  provides  both  I  and  Q  output  signals  (90°  out  of  phase). 


I  IN  (Fr)  Q  IN  (Fr) 


Figure  5.2:  Single  feedback  oscillator  frequency  translator. 


From  the  convergence  analysis,  we  have  the  following  dynamical  equations  for  the  oscillator 
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output: 


1 

— a  = 
coo 

—a  +  rp(da)  cos  # 

(64) 

1 

— a  = 
U)Q 

-rg(da)  sin#. 
a 

(65) 

The  convergence  analysis  showed  that  the  output  amplitude  a  converged  to  a  constant  value,  so 
that  in  steady  state, 

—  a  +  rp(dci)  cos  #  =  0.  (66) 

The  steady-state  equation  for  a,  which  represents  the  output  signal  phase  with  respect  to  the 
oscillator  input  frequency,  then  becomes 

— d  =  tan#,  (67) 

coo 

where  #  is  assumed  to  be  constant.  Hence,  the  phase  of  the  output  signal,  in  steady  state, 
advances  at  a  constant  rate  given  by  wotan#,  which  means  that  the  output  is  frequency-shifted 
with  repect  to  the  input  by  coo  tan#. 

Thus,  the  output  frequency  of  the  oscillator  circuit  is  given  by  the  input  frequency  plus 
a  term  which  depends  on  RC  values  (wo)  times  a  term  which  is  given  by  dc  electrical  inputs 
(tan#).  Therefore,  if  a  number  of  oscillators  which  are  identical  except  for  geometrically  scaled 
u) o  values  are  driven  with  the  same  input  frequency,  the  electrical  input  c  =  de can  be  used 
to  correct  for  processing  uncertanties  in  the  coo  values.  This  is  an  important  feature  for  a 
microelectronic  circuit,  because  while  ratios  of  time  constants  can  be  made  relatively  accurately 
on  an  IC,  the  absolute  values  have  a  very  large  uncertainty  (as  high  as  50%).  Furthermore, 
using  feedback  control,  #  could  be  controlled  to  maintain  the  correct  frequency  ratios  despite 
temperature  changes. 

Examination  of  the  dynamics  for  a,  equation  (64),  reveals  that  in  order  to  destabilize 
the  origin  as  an  equilibrium  point,  \9\  must  be  sufficiently  close  to  zero  and  /3da  must  be  large 
enough  to  overcome  the  decay  term  —a.  The  larger  j3d  is,  the  larger  |#|  can  be,  up  to  tt/2,  where 
the  feedback  is  guaranteed  to  become  negative.  If  #  =  0,  then  the  small  signal  gain  through 
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the  feedback  loop  must  be  greater  than  unity  to  prevent  the  oscillator  output  from  decaying. 
In  practice,  there  is  a  tradeoff  between  having  a  low  feedback  loop  gain  (to  minimize  power 
dissipation)  and  control  authority  through  6. 

Even  though  the  steady  state  output  amplitude  depends  on  both  d  and  6 ,  the  magnitude 
and  polar  angle  of  the  complex  input  c,  the  output  frequency  only  depends  on  6  and  is  indepen¬ 
dent  of  d.  Therefore,  the  output  frequency  and  amplitude  can  be  tuned  sequentially,  another 
nice  feature  of  this  oscillator  circuit. 

5.2.3  Design  Equations  for  transient  operation 

For  the  transient  analysis  of  the  circuit  starting  from  an  initial  condition  near  the  origin 
so  that  the  output  appears  as  a  sine-wave  burst  with  exponentially  growing  envelope,  we  need 
to  reexamine  the  dynamical  equations  for  a  and  a.  If  we  assume  that  the  slope  of  r(-)  is  unity 
at  the  origin,  then  the  dynamics  become,  approximately, 

— d  =  ((3dcos6  —  l)a  (68) 

u>o 

— a  =  (3d  sin  6.  (69) 

Co>0 

Both  the  output  frequency  shift  ojo(3d  sin  6  and  the  time  constant  associated  with  the  exponential 
growth,  l/[wo(/3dcos  6  —  1)],  depend  on  d  and  6.  The  design  equations  for  this  case  are  thus  two 
equations  in  two  unknowns.  In  fact,  since  coo  is  also  a  design  parameter,  many  combinations  of 
output  frequency  and  envelope  time  constant  can  be  obtained. 

6.  Implementation  of  Coupled  Oscillator  Circuits  in  Analog  CMOS 

To  illustrate  one  approach  for  implementing  the  oscillator  dynamics  described  in  this 
work  in  analog  CMOS  hardware,  consider  the  single  feedback  oscillator  circuit  of  figure  5.2. 
The  transistor-level  circuit  design  basically  comes  down  to  deciding  what  type  of  four-quadrant 
multipliers  to  use  for  the  ten  multipliers  appearing  in  the  circuit,  and  then  ensuring  that  the 
small-signal  gain,  sigmoidal  nonlinearity,  and  lowpass  filter  time  constant  are  correctly  accounted 
for.  The  two  multipliers  whose  outputs  go  to  the  low-pass  filters  are  identical,  the  four  multipliers 
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which  perform  the  complex  multiplication  between  the  lowpass  filter  outputs  and  C  are  identical, 
and  the  four  multipliers  which  produce  the  I  and  Q  output  signals  are  identical,  so  the  design 
problem  reduces  to  the  design  of  only  three  distinct  multiplier  circuits. 

Based  on  the  success  of  the  wide-range  Gilbert  multiplier  circuits  used  in  [19],  the  wide- 
range  Gilbert  multiplier  circuit,  shown  in  figure  6.1,  would  be  a  good  choice  for  all  three  distinct 
multiplier  circuits.  However,  different  choices  of  transistor  sizes  are  needed  to  provide  the  ap¬ 
propriate  small-signal  gain  and  saturating  characteristic.  Figure  6.2  shows  multiplier  star  curves 
(from  a  PSPICE  simulation)  appropriate  for  the  input-saturating  multiplier.  A  fundamentally 
different  approach  for  implementing  the  oscillator  dynamics  directly  in  the  form  of  complex 
signals  instead  of  as  high-frequency  real  signals  with  different  phases  is  described  in  [9], 


Figure  6.1:  Wide-range  Gilbert  multiplier  circuit. 
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Figure  6.2:  Simulated  star  curves  for  multiplier  with  saturating  input  characteristic. 
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7.  Conclusion 


To  summarize,  convergence  results  for  a  class  of  networks  of  nonlinear  coupled  oscillators 
(or  directional  units,  depending  on  the  point  of  view  taken)  have  been  presented.  Physical 
motivation  has  been  given  for  the  simplest  network  considered,  but  the  convergence  results  for 
the  rest  of  the  networks  are  based  solely  on  the  adaptability  of  the  original  Lyapunov  function 
arguments  to  the  various  networks. 

The  first  modification  to  the  fixed-weight  network  was  the  adaptively  controlled  network, 
which  might  be  of  interest  for  hierarchical  control  in  systems  with  both  local  and  global  feedback. 
The  second  modification  was  the  incorporation  of  external  control  inputs  to  the  coupled  oscillator 
network,  and  the  example  discussed  was  a  pair  of  coupled  oscillators  for  correcting  for  the 
feedback  path  phase  shift  of  a  complex  LMS  loop  for  adaptive  filter  applications.  The  third 
modification  yielded  a  single  oscillator  with  feedback  through  a  complex  weight,  producing 
a  circuit  of  potential  interest  for  continuous  wavelet  transform  applications.  Analog  CMOS 
implementation  of  the  coupled  oscillator  dynamics  was  also  briefly  discussed. 

This  work  represents  a  first  attempt  at  applying  a  particularly  basic  form  of  coupled 
oscillator  network  to  actual  engineering  problems.  What  the  most  useful  oscillator  network 
paradigms  are,  to  what  extent  oscillator  networks  can  be  used  in  hierarchical  control  systems, 
and  what  the  best  implementation  techniques  are  for  high-speed  analog  circuit  implementation 
all  remain  open  questions. 
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